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Simulation,  Color  Graphics,  Sampling  Experiment. 
Multi-factor  Simulation.  Wultl server 
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A  simulation  Is  essentially  a  multi -factor  statistical  sampling  experiment  through  which 
approximate  answers  to  questions  about  some  aspect  of  a  system  or  statistic  are  obtained. 
Unfortunately  the  multi-factor  aspect  of  the  slnulition  is  usually  downplayed  because  of  the 
difficulties  of  organizing  and  displaying  the  output  as  ■  function  of  various  factors.  Some 
graphical  procedures  using  colon  are  suggested  for  assessing  the  effect  of  the  factors  on  t" 
output.  This  1$  done  In  the  cente-t  of  an  example  of  a  multiserver  queue.  Classical 
analysis  of  variance  techniques  are  usually  not  appropriate  for  this  analysis  because  the 
data  Is  non-normal  and  the  mean  1$  seldom  an  adequate  or  complete  characterization  of  the 
output. 
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AflSrWCT 

A  ainuUtlon  la  eaaentUAly  a  nultl-raetor  autlaileal  ■aapllni  eiperlaent 
through  which  approximate  anawera  to  queatlona  about  aoae  aapect  of  a  ayataa 
or  .'tatlatlc  are  obtained.  i/..rortunately«  the  muUl'ractor  aapect  of  the 
alauUtion  la  itaually  downplayed  bacauae  of  the  dirfleultlea  of  erganlxing 
and  dlaplaying  the  output  u  a  function  of  varloua  faetora.  Seae  graphical 
procedurea  uaing  color  are  auggeated  for  aaaeaalng  the  effect  of  the  faetora 
on  the  Output.  This  ia  done  In  the  context  of  an  example  of  a  auJtiaerver 
queue.  Claablcal  analyala  of  vaclanee  techniqwea  are  uaually  not  appropriate 
for  this  analyala  because  the  data  ia  non*‘noraal  and  the  mean  la  aeldoo  an 
adequate  or  complete  ehoraeteriutlon  of  the  output. 


INTNOOl«TION 


Sieulation  Is  a  widely  used  tool  fer  finding  anawera  to  problema  wltieh 
Involve  random  cleMnts  in  fields  u  diverse  as  Statistics,  Physics, 
Operatlora  Analysis,  and  engineering.  It  la  essentially  a  multl*faetor 
statiatiral  saepling  experiment  which,  with  a  model,  la  performed  on  a 
digital  computer.  Moreover,  the  anawera  obtained  from  the  simulation  are 
functions  of  the  various  factors  (attributes,  independent  variables, 
ccncooitsnts)  in  the  problem. 

A  very  simple  example  of  such  e  proolem  is  the  multiserver  queue  (C/C/m) 
which  occurs  in  banks,  aupemsrkets,  barbershops,  stc.  In  this  queueing 
system,  arriving  customers  are  served  In  order  of  arrival,  with  one  of  two 
queueing  disciplines.  The  first  discipline  la  where  customera  form  a  alnglt 
line  and  arc  called  for  service  from  the  head  of  thLt  line  sa  servers  beccre 
free.  The  second  queueing  discipline  Is  where  customera  Join  the  separate 
queues  wr.icn  form  in  front  of  each  server  and  stay  there  until  served.  As 
an  Ideal!;'  -lor.  of  this  second  diaclplire,  an  arriving  customer  joins  the 
Shortest  and  presunably  the  fastest  aervicd  line  or  picks,  with  equal 
protasility.  f.’oi*  lines  which  have  the  tied,  fewest  number  of  customers 
avilMng  service.  No  Jumping  from  server  lo  Server  is  allowed. 

:.*!€  roug.h  jwtlfication  for  the  single  line  discipline,  denv'ieo  as  SL,  ever 
tnc  shortest  line,  fastest  ssrvlce  queueing  discipline  (fS)  is  that  an 
arriv;n|  curtone'*  wjl’.  not  gel  stucw  behind  a  cuitomer  whe  is  already  In 
service  and  ur.o  haa  an  extr  snely  long  service  tl*e.  However  bein 
diiciplines  are  oonRonly  u£  1,  and  the  question  to  W  answered  is  which 
discipline  is  'best'.  Cf  c  jrse  this  question  is  unarjwerable  as  posed 
until  the  proper  quantiflcaticr  of  the  proMer.  is  secidre  open.  Trus,  is  it 
adeq’iate  to  conpare  tr.e  mean  waiting  times  in  a  itationary  queue,  or  mould 


1 
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on«  eo«ipare  the  probabilities  of  not  having  to  wait  on  arrival  at  the  c}ueue 
or  the  values  of,  sayi  the  .99  quantile  of  the  watting  tine  distributions? 
(The  o-quantile  of  the  distribution  of  a  randoei  variabiei  V,  is  the  value, 
w^,  such  that  the  probability  of  W  being  leas  than  w^  is  o). 

Furthermore,  even  if  one  of  the  above  quantifications  is  decided  upon  and 
its  value  is  eonpared  for  the  two  service  disciplines,  the  answer  to  the 
question  as  to  which  service  discipline  is  best  may  depend  on  the  level  of 
several  other  factors,  as  follows: 

a.  The  traffic  intensity  is,  from  what  theory  exists,  a 
definite  factor  here.  In  this  queueing  problem  the  traffic 
intensity  is  given  by  the  ratio  of  the  expected  service 
time,  E(S),  divided  by  the  product  of  the  number  of 
servers,  m,  and  the  expected  Interarrivsl  time  of 
customers,  E(a).  Tnis  traffic  intensity  factor,  t,  must  be 
less  than  l  for  s  stable  queue  to  exist  and  has  a  continuum 
of  posalble  values  between  0  and  1.  Three  values  of  t  will 
be  used  in  the  subsequent  snalysit*  0,30,  0.60  and  0.75. 

b.  The  number  of  servers,  m,  is  a  factor  whidi  may  influence 
the  output  and  must  clearly  be  greater  than  one  for  the 
distinction  between  the  single  line  (SU)  end  the  ahOPtast 
lint,  fastest  atrvioe,  (r'S)  disciplines  to  htve  any 
meaning.  Tnree  values  of  m  will  be  used  in  the  subsequent 
analysis,  3,  5,  and  10 

c.  The  distribution  of  service  titves  (in  G/C/m  queues  assumed 
to  be  independent  and  identically  distributed)  and  the 
distribution  of  interarrival  times  (also  assumed  to  be 
independent  and  identically  distributed)  are  also  factors 
in  this  queueing  situation.  Because  of  the  complexity  of 
these  factors  only  four  combinations  of  distributions  will 
be  used  in  the  subsequent  analysis: 

A  -  very  variable  service;  very  variable  interarrlval; 

B  -  vvry  regular  service;  very  variable  interarrivsl; 

J  -  very  variable  service;  very  regular  interarrivsl 

D  -  very  regular  service;  very  regular  interarrivsl: 

This  rough  cstegorlzation  will  be  more  specifically 
detailed  later  for  the  purpose  of  inplementing  the 
sinulation:  the  categorisation  represents  an  attempt  to  cut 
down  a  conp'.ex  facter  to  nanageable  proportions  based  on 
experience.  A  rough  |ueus  would  be  that  if  the  single  line 
queueing  discipline  is  effective  in  cutting  jown,  Ir.  some 
sense,  the  waiting  tines  of  customers,  it  will  be  in  case 
A,  where  very  variable  or  shewed  service  anc  irterarrival 
tinea  are  encountered.  In  that  case  not  only  sre  long 
service  tines  relatively  comnon,  but  also  customers  nay 
occasionally  arrive  in  quick  succession. 

With  three  levels  of  the  traffic  intensity  factor  t,  three  values  of  n.  the 
number  cf  servers,  four  conbinatlons  of  interarrivsl  and  service  time 
distributions  ard  two  queueing  disciplines,  giving  factor  core: rations,  .» 


< 


simulation  txptriment  with  a  fixed  number  of  replications  at  each  faotor 
level  is  teehnically  handleable  b>  a  four-uay  analysis  of  variance.  The 
reason  that  thia  ia  not  approprlat*  and  that  a  9>aphleal  avwary  of  the 
output  ia  Atoeaaary  ia  that  by  eaaparlami  of  tha  aeaaa  of  the  data  are  not 
•???*•*•  *®1^**«  *•  fienMlly  dlatributad.  In  fact  the  uaiiirtf  tl^ 

mill  lanarally  bo  vary  poaitivaly  akawtd  with  a  diaorata  component 

tha  probability  that  a  ouatonera  uaiting  tltaa  la  axaetly  taro, 
wthar  conplieating  tha  standard  analyeia  ia  tha  fact  that  tha  ralationahip 
between  tha  factors  will  not  ba  linear.  For  example,  in  many  queueing 
situations  the  mean  waiting  time,  E<i#),  is  proportional  to  the  reciprocal  of 

V  )  • 

An  alternative  to  a  blind  and  perhaps  inappropriate  application  of  analysis 
of  variance  techniques  is  to  first  look  at  the  simulation  output  data  in 
order  to  perform  an  initial,  exploratory  analysis.  This  may  show  iamedlately 
the  salient  points  of  the  simulation,  or  suggest  further  formal  analysis 
after,  for  example,  a  transformation  of  the  data. 

The  problem  of  differentiating  four  factors  gruphically  is  net  simple,  and 
in  this  paper  we  will  attempt  to  obtain  as  concise  and  aa  compact  a  summary 
of  the  output  of  the  simulation  e<periment  as  possible.  This  will  be  done 
graphically  by  using  multiple  X~T  plots*  with  additional  coding  within  each 
plot  obtained  by  color,  spacing,  and  line-^type. 


TIC  DATA  FAOM  THE  G/C/m  QUEUE 

To  comp.  the  specification  of  tne  multiple  server  queue  discussed  above 
It  vas  as;umed  that  the  individual  service  times  were  Cawaa  distributed,  as 
were  the  .ndependent  inierarrival  times. 

To  obtain  'regular'  aervlce,  it  was  assumed  that  the  shape  parameter,  X,  in 
the  Gamma  distribution  look  on  the  value  5.0;  to  obtain  very  'variable'  i.e« 
'highly  postively  skewed'  service  lines  it  was  assianed  that  the  shape 
parameter  k  took  on  the  value  0.5.  Similar  conventlona  were  made  for  the 
inter arrival  times. 

The  Gamma  assumpticn  was  made  for  computational  convenience:  another 
possibility  is  to  assume  that  the  'variable'  distribution  is  obtained  by  a 
mixture  cf  two  exponential  random  variables.  In  that  case  analytical 
solctior.s  can,  in  principle,  be  obtained  for  parts  of  the  problem  by  the 
method  of  (parallel^  stages  (Kleinrock  19T5). 

For  each  set  of  the  ?2  factor  levels,  the  queue  was  simulated  out  to  the 
S,C00th  arrival.  This  was  repeated  independently  ^^wo  times  to  obtain  a 
vector  of  i.i.d  realisations  of  waiting  tines  of  the  5000th  custoeer.  Since 
ir.e  traffic  intensity  was  chosen  to  n-ve  the  levels  0.30,  0.60  and  C.‘'5.  it 
can  be  assumed  that  the  samples  represent  the  stationary  waiting  time  in  the 
queue.  It  coulo  be  argued  that  a  higher  level  of  t,  say  C,9u,  should  also 
be  used.  However,  not  only  would  it  then  be  necessary  to  go  out  even  beyond 
tne  SCDCth  customer  in  the  sample  path  of  the  queue  to  ast^ure  stationary, 
but  also  the  already  complex  data  handling  problem  with  the  7?  waiting  time 
vtcicrs  would  be  further  ccmplieated.  Alto,  as  wir.  be  seen,  the  essential 
effects  of  the  factors  can  be  ascertained  frcn  the  present  experiment. 


0;.t«  was  plaotd  into  veotora  of  ler>cth  )I40  with  a  typical  case  being  named 
USU)?75g.  Here  the  first  U  denoted  a  waiting  time  and  occurs  in  the  code 
for  all  vectors.  (One  could  rlso  look.  say.  at  delay  tines.  These  are  the 
custoner's  waiting  tine  plus  his  service  tine.)  SL  denotes  'single  line 
queueing  discipline*  whereas  the  other  discipline.  Joining  the  shortMt  and 
thus  presumably  the  fsstest  line,  is  denoted  by  7S.  The  first  pair  of 
numbers  in  the  name  of  the  data  vector.  02  in  this  erjmple.  represent  tn,  **'.0 
number  cf  servers,  and  could  be  2.5  or  10.  The  second  set  of  nunters.  here 
*75'.  fives  the  trsffie  intensity,  t.  and  could  be  30,  60  or  75. 
representing  values  of  t»0.30,  1*0.60  and  t»0.75.  Finally  the  last  Jntter, 
here  *A'.  represents  the  four  cases  of  distributions!  assumptions  given 
above  with  possible  values  A,  C,  C  or  0. 


COMPUTING 


The  data  were  generated  on  an  IBM  370/3033  computer  using  a  PL/i  program 
called  QSIN.  The  grsphk^s  was  done  with  the  exptrinentsl  APL  program 
CRAPoTAT  from  IBM  Reaeaich.  The  coding  of  the  data  vectors  explained  above 
nade  it  sinole  tc  generate  the  full  screen  interfaces  for  CRAFSTAT,  and  thus 
the  graphs,  under  prolan  control.  Since  many  oonbinationa  of  graphs  were 
tried,  this  procedure  proved  very  valuable. 

The  plots  were  obtained  In  twe  waya*  one  by  sending  CRAPSTAT  output  on  an 
IBM  3179  Model  02  terainal  to  an  IBM  7372  plotter,  the  other  by  sending 
CRAFSTAT  output  on  an  IBM  3270  AT  CX  color  screen  to  the  asme  plotter.  In 
both  cases  the  t**ansfe.*  is  aoccuplished  by  invoking  the  GODMA  program  on  the 
mainframe. 

ft^th  APL  and  the  GRAFSTAT  program  are  ideal  for  handling  a  large  amount  of 
data  like  this  in  a  very  flexible  fashion. 

GRAPHICAL  OVrPirr  AND  ANAo'^SlS 

The  graphics  which  were  designed  to  displsy  the  output  of  the  sisulation 
experiment  can  be  thought  of  as  a  two  way  layout  of  two-dimensional  graphs, 
with  rows  of  graphs  representing  a  fixed  dlstrlbutlc»nsl  facior  (A,  B,  C  or 
0)  and  the  columns  of  graplis  representing  the  'number  of  aervers'  factor. 
(This  was  selected  as  the  column  factor  because  it  was  felt  that  this  factor 
would  have  a  minor  effect  on  waiting  times,  although  the  simulation 
subsequently  showed  that  this  assumption  was  not  correct). 

Tne  complete  layout  of  all  i2  graphs  is  not  shewn;  in  fact  for  reasons  o'* 
space,  only  the  first  row  of  graphs  hsving  common  distributional  factor  A 
will  be  discussed. 

Each  graph  ir.  the  two  way  layout  represents  six  esses,  three  traffic 
intensities  and  two  queueing  dlaciplines  (see  Figure  1).  The  two  queueing 
disciplines  for  each  of  the  three  values  of  traffic  intensity  are  placed 
close  together  on  the  graph  since  queueing  discipline  is  the  primary  factor 
whose  effect  on  the  response  -  waiting  time  •  is  to  be  examined.  This 
'waiting  time*  response  is  represented  on  the  vertical  axis  by  a  quantile 

plot. 


Figure  1.  TW  servers  end  distributions!  esse  A  "  very  vsrisble 

(pos-it; vely-3i<ewed>  service;  very  vcrisble  (positively^ skewed;  intersrrivsi 
times.  The  two  quantile  plots  of  the  *»'!0  Simulated  waiting  tines  at  each  of 
the  three  traffic  intensities  are  grouped  together  and  differentiated  oy 
color.  Slue  is  used  for  the  'fastest  service',  individual  choice,  case  (FSJ 
ind  red  for  the  singes  line  iSt)  case.  Note  that  there  are  many  zero 
•ailing  times  and  that  this  aspect  is  not  shown  in  the  graph  expect  in  so 
far  as  the  quantile  riots  and  the  means  and  mediians  are  ourched  near  zero. 


■Hi*  quAfittl*  plot  is  «  vertical  line  with  narks  representing  various 
estinated  quantiles  and  the  eatinated  nean  of  the  sinple  of  size  Mko.  the 
clearest  case  on  which  to  ezaalne  these  narks  is  given  in  Figure  1  for 
t-0.75  and  the  blue  (R>)  line.  The  tllda  at  the  botten  of  ttie  line  is  the 
0.2S**quanti}e  or  ls)wer  quartilc  of  the  sating  tine  sanplej  going  upwards, 
the  cross  is  the  O.^l-quartile  or  nedlan;  the  circle  is  the  sanple  nean.  » 
Above  th.s  are  horizontal  bars  representing  euecessively  the  0.7&-quantile 
or  upper^quartile,  the  0.95*^antile,  the  0.99*quantile,  and  the  naxinun 
value  in  the  aanple. 

Concentrating  on  the  case  illustrated  in  Figure  t  (n»2s  t»0.75{  A)  it  is 
seen  iiMedieteljr  that  the  single  lint  discipline  (SL)  in  red  gives  slightly 
shorter  usiling  tints  then  the  FS  ease  and  that  the  distributions  of  waiting 
tines  are  highly,  positively  skewed.  It  should  be  noted  thet  in  all  oases 
consid^ed  there  were  nany  zero  waiting  tines  which  resulted  in  a  great 
squashing  of  the  lower  quantilM  on  the  gra^.  in  fact  s  eoemon  alternative 
to  the  quentil*  plot  is  s  boxplot,  which  nany  people  prefer,  but  in  this 
case  It  is  difficult  to  plot  since  nany  outliars  occur  at  the  low  end  and 
have  the  sane  value.  A  boxplot  results  in  the  pen  plotter  Just  cutting  s 
hole  in  the  paper. 

note  also  that  on  this  graph  one  canrot  'see*  the  extent  of  the  probability 
of  zero  waiting  tines,  which  is  an  inportant  qualification  of  the  queueing 
systen.  Thus,  either  a  table  or  a  graph  of  this  probability  should  be  given 
separately.  Tt.e  zero«valued  waiting  tisea  also  sake  it  difficult  to  cnploy, 
for  example,  logarlthnlc  irenafomctitmt  of  thw  data  or  the  sealee.  this 
can  be  obviated  by  plotting  the  non*zero  waiting  tinea  or  by  looking  at 
delay  tines  (the  waiting  tine  plus  the  service  tine).  However,  this  latter 
quantity  is  not  always  neaningful  in  such  a  sinple  queue. 

Returning  to  Figure  1  end  contraeting  the  effect  of  traffic  intensity  for 
the  two  service  disciplines  with  n«2  and  distributional  case  A,  we  see  first 
that  the  effect  of  traffic  Intensity  is  narked.  This  of  course  is  fairly 
well  known,  in  particular  for  the  Foisson  arrival.  Cxponen*^ial  service 
caac.  the  expected  waiting  time  ia  proportional  to  t/M-t)*  (Caver  B.id 
Thompson,  1973).  However,  the  welting  tines  arc  not  effected  markedly  by 
the  service  discipline  el  any  of, the  traffic  intenaitieo  conai dared.  In 
fact,  the  apparent  differences  between  the  FS  and  the  SL  cases  nay  not  be 
statistically  signif leant. 

Figures  2  and  3  cor«plete  the  top  row  of  the  two  way  layout  of  graphs, 

Showing  the  effect  of  nunber  of  servere,  s.  on  the  waiting  times  for 
different  traffic  intensities  and  different  quetwing  disciplines.  A 
comparison  of  rigurej  *  and  3  reveals  very  quickly  that  if  the  traffic 
I'tensity  is  held  vor.^tart,  then  waiting  tines  tend  to  decreare  as  the 
r.u^nber  of  servera  increisc.  This  is  especially  true  at  low  traffic 
intenaties.  Moreover  going  from  Figure  i  to  Figure  3  it  becomes  eJear  very 
'-apidly  that  the  effect  of  the  two  fiff^rent  queueing  disciplines  or.  waiting 
times  becomes  narked  as  the  number  of  servers  increases!  Thus,  using  a 
single  line  with  very  variable  service  and  Interarrival  .imes  ia  really 
effective  in  lowering  the  waiting  times  only  when  the  queue  has  many 
servers . 
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Fitur«  2.  r»v®  serv«rs  t«-5)  *rt«J  dlstrlbutlorai  cus*  A  -  »ery  variabl# 
(pStive:y-3K*w*<l>  n«rtice;  vtry  variable  (posltlve’y-*Kwed>  intcrarrival 
nZl:  tJ*  tvo  quantiu  plots  of  lh«  simwUlta  naitinj  limes  ai  each  of 
the  three  traffic  intefisltiaa  are  irouped  tofethar  anC 

colo-,  81 ae  is  used  for  the  ’fastest  service’,  individual  choice,  case  .FS) 
and  rid  for  the  single  line  (SUl  cate.  Note  tnat  there  are  many  aero 
ea.-.ing  times  and  that  tnis  aspect  it  not  shoun  in  the 
far  a8*tne  quantile  pluia  and  the  means  and  mtatan.n  are  bunched  near  lero. 
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Figure  3.  Tw  servers  im-UT  and  <}Js;ritHitlonal  case  A  -  very  variable 
<positivoly-SKewed)  service;  very  variable  (positively-skewed)  Interarrlval 
tjmes.  The  two  quintilt  plots  of  the  kao  simulated  waiting  ti«<ies  at  each  of 
tftt.  tnree  traffic  Intensities  are  grouped  together  and  differentiated  by 
"olor.  31u9  is  used  for  the  'rast«*st  service’,  indivllual  choice,  case  (FS) 
and  red  for  the  sifgle  line  (SL)  case.  Kote  that  there  d-e  many  aero 
waiting  times  and  this  aspect  is  not  shown  in  the  ®raph  expect  In  so  far  as 
the  cuantlle  plots  and  the  means  and  medians  are  bunched  near  aero. 


m  or  coicr.  and  .;h kuncemehts 


Color  has  bctn  used  to  diff#r<»ntlat«!  ths  closely  grouped  quantile  plots  for 
the  two  queueing  disciplines  on  the  graphs.  It  is  auch  more  effective  than, 
say,  line'type  in  differentiating  the  two  cases  to  the  eye.  Actually,  a 
comhinatlon  of  line-type  and  color  aeeas  *.o  work  even  better  but  it  seaos  to 
be  a  waste  of  an  additional  coding  device  which  can  be  used  to  farther 
coepactify  the  graphical  output.  This  can  be  done  by  auperimpoaing  figure  l 
on  figure  2  with  a  slight  left  shift  and  using  dashes  for  the  vertical  lines 
in  the  quantile  plots.  Sinilarly  figure  3  is  suoer posed  on  figure  ?  with 
the  sa«v  shift,  this  time  to  the  right  and  using  dotted  lines  for  the 
vertical  lines  in  the  quantile  plots. 

If  additional  colwa  are  available,  the  coding  by  line-type  can  be  replaced 
by  cooing  by  color,  while  the  two  queueing  diaciplinea  are  differentiated  by 
line-type.  TMa  aeena  to  be  the  *beat*  combination  available.  However, 
that  many  colors  .re  difficult  to  plot  on  the  available  equipment. 


ulWCLUSlOWS 

The  need  to  coepactify  as  much  as  possible  the  ^aj^ical  analysis  of 
simulation  output  so  that  the  results  can  ba  enoompasacd  by  an  analyst  la 
greatly  enhanced  by  the  availability  of  color  as  a  coding  device.  The  types 
of  graphs  presented  here  should  be  standard  tools  for  simulators  and  it  *a 
hoped  that  this  will  be  the  case  when  color  graphics,  and  especially  the 
printed  version,  becomes  easier  and  cheaper  to  obtain. 
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